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ABSTRACT 

The relative power of college culture, school 
functioning, and mission in explaining student performance outcomes 
was examined. Th« relationship between institutional 
attributes/cultures and undergraduate instructional effectiveness as 
perceived by faculty and administrators was studied with 320 
four-year colleges. Respondents completed the Assessment of the 
Performance of Colleges and Universities survey in 1983. 
Instructional effectiveness variables included: student educational 
satisfaction, academic devjelopnent , career development, and personal 
development. Institutional characteristics included: full-time 
equivalent enrollment, percentage of professional degrees, percentage 
of part-time headcount, percentage of undergraduate headcount, 
student selectivity, and institutional control and type. Also 
considered were: four institutional mission and mission agreement 
variables (special identity, distinctive purpose, mission reflected 
in academic programs, ai^d shared definition of mission); four 
institutional culture variables (clan, emerci'^nt environment, 
hierarchy, and market orientation); and four - nstitutional 
functioning variables (level of trust, recog it ion and rewards 
received, amount of information or feedback, and student-faculty 
relationships). Associations were analyzed using stepwise multiple 
regression. Appended are (1) a Correlation Matrix, and (2) a basic 
statistical breakdown on all studv variables. Fifty-two references 
are listed. (SH) 
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The Importance of Looking Deeper 



Introduction 

Assessing and improving the effectiveness of undergraduate Instruction has 
recently taken on a new urgency In public dialogue. National reports such as 
NIE's Involvement in Learning (1984), AAC's Integrity in the College Curriculum 
(1985), and NEH's To Reclaim a Legacy (1984) have not only direct<id attention 
toward undergraduate Instruction, but have also raised many questions about how 
"effectiveness" is to be defined and attained. Such attention, of course, is 
not new. Indeed, it is one of the features of American higher education to 
periodically raise and wrestle with such questions. But a key aspect of the 
current discussion Is that it is largely founded upon actual research about 
what works and what does not in promoting effective undergraduate instruction. 
This study attempts to further this discussion. 

Two quite different streams of research have contributed to recent debates 
about effectiveness in higher education. Both are important as guides to 
action. The first line of inquiry concentrates on actual student learning and 
development, and poses as its research question the degree to which particular 
outcomes can be associated with particular combinations of instituticnal 
characteristics, environments, and instructional strategies. Here the analytic 
focus is placed quite clearly on the Individual student—the object being to 
explain patterns of Individual growth and behavior in terms of clusters of 
external factors. The second approach to defining and promoting 
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"effectiveness," In contrast, takes the institution as its unit of analysis. 
Here, the major research question is the degree to which organizational 
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functioning and survival can be explained In terms of patterns of structural 
organization, of culture, and of adaptation In the context of a changing 
external environment. 



Both of these traditions of research have a rich literature, but their 
Implications for practice have rarely been linked. The first tradition, for 
example, suggests many empirical connections between such factors as 
institutional size, control, and selectivity on the one hand, and student 
learning and development on the other. But this research can rarely 
demonstrate the behavioral mechanisms responsible for the association. More 
importantly, there are many individual exceptions to the expected relationships 
(Bowen 1978): some institutions do much better than others that share similar 
structural characteristics. At the same time, the second tradition has but 
rarely examined actual changes or perceived changes in teaching effectiveness 
as a function of organizational culture. Findings from this literature, 
however, suggest that such factors as substantial agreement on m^'ssion, a 
close-knit pattern of belief and communication, and active modification of 
programs and services to ^ it the needs of new student clienteles all may have 
an impact on instructional effectiveness. 

Together, these two sets of findings suggest some useful connections. First, 
if possible, variables on organizational culture should accompany institutional 
characteristic variables in explaining patterns of student learning and 
development— even if the actual measures of outcomes must be Indirect (as they 
are in the current study). Secondly, faculty and administrator perceptions of 
undergraduate outcomes are Important in their own right, as indicators of the 
priority and commitment accorded these outcomes in particular organizational 
settings. Changing perceptions and commitments may be a critical step In 



accomplishing more basic shifts in student performance and satisfaction. And 
If cultural factors emerge as Important in explaining such perceptions, 
traditional remedies for Improvement based solely upon curriculum content, 
instructional technology, and the physical structure of the learning enviroment 
will need to be tempered. 

Student Outcomes and Their Correlates 

Systematic studies of the Impact of college on students have a long history, 
and have been directed at many facets of student experience (Pace 1979). 
Findings of this research have been diverse, but generally cluster around two 
basic themes. First, mort studies find substantial differences in the 
determinants of cognitive and non-cognitive development. For example, Bowen 
(1977) notes considerable difficulty In establishing clear connections between 
institutional characteristics and actual cognitive growth. This literature, 
however, has established many linkages between attitudinal and personal growth 
and the physical characteristics of institutions (for example, Chickering 1969, 
Feldman and Newcomb 1969, Pace 1972, Astin, Panos and Kreager 1967, Astin 1977, 
Astin and Lee 1972). All these findings, however, are conditioned by the fact 
that students are not randomly distributed across institutions. Rather 
different types of students tend to cluster in different types of institutions 
because of institutional and self-selectivity. 

Secondly, most studies have documented considerable differences in the impacts 
of institution-level characteristics (for example institutional size, control, 
and selectivity), and more circumscribed elements of the teaching/learning 
environment within the institution (for example student-faculty contact, class 
size, teaching technology, and student involvement). Indeed, one of the main 
difficulties of actually doi jg student impact research is to decide what level 



of analysis constitutes the relevant environment for student develop^ient (Baird 
1976, Hartnett and Centra 1977. Hartnett 1976, Gray, Wei don, and Romney 1979, 
Ewell 1984)* In some settings the relevant environment will be the Institution 
as a whole, in others, the department or school, and In still others, the 
residence hall or social group. Finally, dlffe^^ent students may undergo quite 
similar experiences, ^ut react to and learn from them differently because of 
different goals, aspirations, and learning styles (Gamson and Associates 1984, 
Katchadourlan and Boll 1985). 

Despite these difficulties, a number of patterns have been established. Among 
the Institutional factors linked to outcomes— particularly noncognltlve 
outcomes—three consistently emerge as Important, First, the total size of the 
Institution, unless mitigated by environmental strategies to create a smaller 
"effective size". Is generally shown to have a negative effuct on student 
development (Astin 1977, Chlckering 1975, Astin, Panos and Creager 1967). 
Secondly, Institutional control— particularly for private Independent, and 
religiously affiliated Institutions— has been shown to have distinctive effects 
on student personal and attltudlnal development (Astin 1977, Face 1972, Pace 
1974, Astin and Lee 1972)* Finally, Institutional selectivity has been 
positively linked with both cognitive and affective development while in 
college (Bowen 1977). 

In addition, a number of elements cf the educational environment have been 
positively linked to particular student outcomes. Among the most Importarit of 
these Is student-faculty Interaction and contact--part1cularly outside the 
classroom (Astin 1977, Feldman and Newcomb 1969, Terenzlnl and Pascarella 
1977). Linkages between student development and full -time attendance, 
on-campus residence, and a balanced set of campus activities have also been 



well established (Astin 1977, Astin 1985). At the same time, there are 
Indications that student noncognltlve development can be linked to both 
currlcular a. 1 extracurricular activities that stress the distinctiveness of a 
particular college or university (Baird 1976). Most of these findings can be 
usefully summarized 1n terms of two basic themes: students learir and develop 
more (1) when they are actively Involved In the curriculum, the campus and the 
learning process (Astin 1984, Astin 1985), and (2) when they are able to make 
maximum use of available campus resources and facilities (Pace 1984, 
Frledlande** 1980). 

Organizational Culture and Institutional Effectiveness 

While the literature on student outcomes takes for granted that a primary 
element of college and university success is that students learn and develop 
while enrolled, a quite different tradition examines the notion of 
institutional effectiveness on a considerably broader front. In fact, one 
prominent feature of this tradition is the inability to consistently define 
effectiveness; indeed, some within this tradition have suggested that the 
concept itself should be dropped (Cameron 1981). For example, in reviewing 
this literature, Krakower notes four distinct approaches to the concept of 
effectiveness (1985). Goal achievement is the most traditional notion of 
effectiveness, and refers to the ability of organizations to actually 
accomplish what they claim to be in business for; for colleges and universities 
all forms of student outx:omes fall within this category. A second type of 
effectiveness is managerial process; within this rubric, an effective 
organization Is one that engages in certain kinds of desired practices—for 
example careful planning, efficient utrlegation, clear communication, explicit 
evaluation of results, and so on. A third area of effectiveness is 



organizational climate; from thU point of view, effective organizations 
primarily serve the Individual needs of those who regularly inhabit them by 
emphasizing working together, by articulating shared values and common symbols, 
and by providing other kinds of rewards. A final approach to effectiveness 
examines the ability of the organization to adapt to changes in its operating 
environment; in this case organizational survival is paramount, and the most 
effective organizations may be the ones that can respond to a shifting 
environment by creating new goals to seek and discovering new constituencies to 
serve. 

Each of these approaches has been extensively employed as a template for 
assessing the "effectiveness" of colleges and universities. Goal achievement, 
of course, has been a primary concern for those examining institutional 
outcomes and return on investment—both at the societal and the institutional 
levels of analysis (Bowen 1977, Lenning 1977). Managerial process has received 
equal attention from practitioners— particularly in the areas of planning, 
resource allocation, control and communication, and management information 
(Baldridge and Tierney 1979; Heick 1978). Organizational climate has been one 
of the most recent but fruitful areas of investigation— stressing the 
distinctive "cultures" of higher education, disciplinary and institutional 
(Clark 1983, Masland 1985), the role of common !nyths, rituals and symbols 
(Clark 1972, Tierney 1985), and the role of leadership in articulating shared 
values and interpretations of the environment (Chaffee 1984). Finally, the 
adaptational approach has been used to explain patterns of institutional 
failure and decline (Zammuto 1983), and responses to decline— particularly in 
the threatened small Independent college sector (Parker and Zammuto 1985, 
Anderson 1977, Finkelstein, Farrar and Pfnister 1984). As Krakower (1985) 
argues, the choice of which notion to choose depends upon where one sits, the 
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kinds of criteria one applies, the unit or level analysis to be employed, the 
time frame of the Investigation, and the kinds of data used. 

What does this broader literature have to contribute to those who concentrate 
on the means for Improving undergraduate Instruction? To begin with. It reminds 
us that the process of changing practice In complex organizations Is Itself 
complex. Simply tinkering with effective size, with curriculum structure, and 
with the Instructional environment will probably not be enough to alter 
outcomes, unless there Is much fuller understanding about how change occurs at 
the Institution In question, about what shapes participant perceptions and 
beliefs, and about what Is valued and rewarded. Secondly, this line of 
Investigation highlights the Importance of intangible factors and assets, which 
can themselves be "managed" by institutional leaders. If distinctive elements 
of Institutional culture are important in maintaining effectiveness, steps can 
be taken to continually articulate and preserve them. Similarly, institutional 
leaders can take care that changes In curriculum and management structure are 
consistent with powerful existing patterns of belief and behavior. 

In general, three themes from the literature on organizational effectiveness 
will be particularly relevant. The first has to do with the role of 
institutional mission and agreement on mission in determining effectiveness. 
Findings here suggest that mission distinctiveness is a good thing, provided 
that the institution simultaneously remains competitive and adaptive (Chaffee 
1984b). Similar findings suggest that agreement on mission is a key correlate 
of perceived effectiveness (Finkel stein, Farrar and Pfnis:er 1984). Indeed, 
lack of both mission distinctiveness and agreement is often cited as a weakness 
among some types of institutions—particularly public comprehensive 
universities (Birnbaum 1984). This leads to a second theme—one that 



emphasizes the distinctive cultural attributes of different kinds of 
institutions. Small private colleges in particular are consistently noted for 
their distinctive commitments, histories, and patterns of interactions (Martin 
1982, Pfnister 1985)"attributes which are magnified in colleges with a unique 
religious tradition or value orientation (Pace 1972). A final theme emphasizes 
the importance of patterns of belief and interaction independent of mission, 
size, and control. Educational organizations have been variously described as 
"organized anarchies" (Baldridge and Deal 1983), as "loosely-coupled systems" 
(Weick lt/7'^), or as "clans" or families (Masland 1985). Each analogy has 
proven apppropriate to a particular range of circumstances, and each helps to 
explain how participants view and value different types of effectiveness. 

Some Hypotheses 

Taken together, these two bodies of research suggest a number of potential 
associations between Institutional attributes and cultures, and undergraduate 
instructional effectiveness—particularly as the latter is perceived by faculty 
and administrators in different institutional settings. Among the factors 
expected to have an impact on effectiveness in promoting student learning and 
development are the following: 

t Institutional Characteristics . These include such concrete factors as 
size, type, control, and selectivity. Hypothesized relationships 
follow directly from the literatures mentioned above. Total 
institutional size is expected to be negatively related to noncognitive 
student development, to be ially unrelated to cognitive 

development, and to have mi^.u relationships with student satisfaction, 
depending upon student career orientation. Institutional type and 
control are expected to show distinctive contributions to noncognitive 
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development for private Independent colleges, and for religious 
institutions. Public general baccalaureate and comprehensive 
institutions are expected to place high in Job preparation, but are 
otherwise expected to be of low instructional effectiveness. No 
systematic relationships are expected between institutional type and 
control, and student cognitive development. Selectivity is expected to 
be strongly related to achievement, but unrelated to student personal 
and career development. 

Institutional Mission and Mission Agreement . All factors that suggest 
a distinctive missio-^ for the Institution are expected to be positively 
related to noncognitive development, but are expected to be essentially 
unrelated to cognitive growth. Student satisfaction is expected to be 
slightly related to mission distinctiveness, on the premise that 
students select themselves into the institutions they attend, and that 
the best "matches" between student expectations and institutional 
environments occur at colleges and universities of strong personality. 
Each of these relationships is expected to be also present for mission 
agreement— the degree to which a range of faculty and administrators at 
the institution concur on the content and distinctiveness of the 
institution's mission. 

Institutional Culture . Institutions characterized by a "clan/' "tribe" 
or "family"-like culture are expected to be strongly related to 
noncognitive development, and somewhat related to student satisfaction. 
Institutions with hierarchical or indeterminant cultures are eroected 
to be slightly negatively related to student satisfaction. Cultural 
variables are not expected to show systematic relationships with 
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cognitive development. As above, agreement on "^ultu^e among a range of 
faculty and administrators at the same Institution Is expected to have 
similar effects as agreement on mission. 

t Institutional Functioning , These variables co'^stitute a somewhat 
different perspective on organizational climate. Rathe>" than 
concentrating on aspects of the culture as a whole, they highlight 
certain elements of administrative behavior that reveal underlying 
values and Incentives. Four such factors &re Included In this 
study--the perceived level of trust throughout the Institution, the 
amount of public recognition and reward Individual faculty and 
administrators feel they receive, the amount of information and 
feedback on performance received on a regular basis and the strength 
and quality of student/faculty interaction. Weak but independent 
associations are expected between each of these factors and student 
noncognitive development. Close student faculty relationships are 
expected to have a strong impact on all outcomes variables except 
career development. 

Interrelations among each of these clusters of variables are expected to be 
strong, but each association mentioned is expected to be essentially 
Independent. Clusters are arranged in loose hierarchy of expected association, 
but the relationships among predictive factors are expected to be sufficiently 
complex that a causal modeling approach that attempts to establish formal 
hierarchies among variables and documents paths of indirect association would 
be unwise. Several studies, for example, have suggested that factors such as 
size and control are responsible for attributes like mission distinctiveness 
and clan culture. But this is a risky assumption given the fact that many 
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Institutions have quite consciously controlled such haracte^ 'sties as size and 
selectivity order to maintain a mission or a cult re (Bowen 1977, Martin 
1982). Iideed, there Is some evidence for small collt^e^ p rtlcular, that 
the discipline needed to keep to such a course of actic has c islderable 
payoff In the long run (Anderson 1977, Chaffee 1984). 

A summary of the expected pattern of relationships between ctlonai 
effectiveness and each of these factors Is presented In 1. Discussic , 

of actual results will follow the logic of this figure. 

Research Method 

The following description of method covers Instruments and sources of data, 
sampling and procedures for he idling missing or Incomplete data, definitions of 
variables, ai^d tho regression techniques used to estimate relationships. 

Instruments and Sources of Data 

Perceptual variables on tiie effectiveness of instruction, on mission and 
mission agreement, on institutional culture, and on elerrents of perceived 
organizational functioning were drawn from items Included in the Assessment of 
the Performance of Colleges and Universities (APCU) survey. The APCU survey is 
a 183-ltem questionnaire developed by the Organiiatlonal Studies program oT the 
National Center for Higher Education Management Systems for the purpose of 
examining a variety of participant perceptions in higher education 
institutions. These perceptions have been related in past studies to one 
another, to institutional response to decline (Parker and Zammuto 1985), and to 
a number of other aspects of institutional performance. The instrument Itself 
has been subjected to extensive r'^view to determine its validity, reliability, 
and statistical properties (Krakouer and Niwa 1985). 
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Figure 1 



Hypothesized Pattern of Relationships Among Variable Blocks 

Student Student Student 

Institutional Student Academic Career Regional 

Variables Sati sf act1 on Devel opment Devel opment Devel opment 

Institutional Characteristics : 
Size 

Public Control +/- 

Religious + 
% Part-Time . + . 

% Profeslonal +/- ++ 

High Selectivity ++ 

Mission: 

Distinctive Mission ++ + ++ 

Mission Agreement ++ ++ 

Institutional Culture : 
Clan ++ ++ 

Hierarchy 
Emergent 
Market 

Institutional Functionin g: 
High Trust ^ + + 

High Reward + + 

High Feedback + + + 

Student/Faculty Relation ++ + -?•+ 



++ = strong positive relation 
+ = weak positive relation 
+/- = high Inter-rater variance 
- - weak negative relation 

— ' strong negative relation 



The APCU questionnaire was field tested, revised, and administered to samples 
of faculty, administrators, and trustees at 334 Institutions In 1983. 
Institutional participation in the survey was Initially approved by the 
president or chancellor. APCU surveys were sent directly to 4-5 top 
administrators and to 4-5 faculty representatives selected randomly from among 
lists provided by each of the institutions. Administrators and faculty were 
chosen as the focal yroups of the survey because of the expectation that their 
positions in institutions were central to tho decisionmaking process. 

The APCU questionnaire is divider into eight substantive sections, each of 
which elicits information about a specific aspect of the institution's 
environment. The first three sections ask respondents to describe recent 
changes in the institution's external environment, in terms of patterns of 
enrollment, and finances. Section 4, titled "Institutional Characteristics", 
contains a variety of items on mission distinctiveness and mission agreement, 
on organizational structure, and on types of managerial activities undertaken. 
This section contains tne items on mission distinctiveness and congruence used 
in this study. Section 5 examines institutional culture and leadership 
characteristics; this section is the source of the institutional culture items 
used in thi. study. Section 6 examines actions t\ker\ in response to the 
environment, and Section 7 examines particular types of institutional decision 
processes. No items Tom these sections were included in the study. Section 8 
contains 32 items on perceived institutional performance. These were 
originally used by Cameron (1978) to construct nine perceived effectiveness 
scales— student, educational satisfaction, student academic development, student 
career development, student personal development, faculty and administrator 
employment satisfaction, professional development and quality of the faculty, 
system openness and community interaction, ability to acquire resources, and 
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organlzatirnal health. Twelve Items from the first fo'jr of these scales were 
used to operational Ize perceived Instructional effectiveness. Three Items from 
the final scale, organizational health, and one additional Item from the 
community Interaction scale were used to operational Ize aspects of 
Institutional functioning. 

For Institutional characteristics variables, several external sources of 
Information were used* Higher Education General Information Survey (HEGIS) 
files were tapped for Information on Institutional size, type, control, 
enrollment characteristics (percent undergraduate and percent part-time), and 
degree program emphasis (percent professional degrees granted). Data on 
Institutional selectivity was provided by the test scores of entering freshmen 
reported by the institution as part of the Coonsrative Institutional Research 
Program (CIRP), or as listed in a standard guidebook for the appropriate year 
such as Barron's Profiles of American Colleges or The College Guide . 

Sampl e 

The sample for this analysis consists of 320 four-year institutions of higher 
e(*ucat1on completing the APCU questionnaire in 1983. This group is part of a 
slightly larger full sample of 334 colleges and universities that participated 
in the study. The 334 sample institutions were drawn from the complete 
universe of institutions listed In the HEGIS data base that had at leist a 
four-year educational program md enrollments of between 200 and 20,000 
students in 1981-82 (N«1317). This population was stratified to produce a 
maximally uiverse sample representative on four variables: institutional size, 
contv^ol (public vs. private), net change in enrollment from 1979 to 1982, and 
baccaUureate-only versus institutions with graduate programs. Overall, the 
sample is representative of the parent population within the limits set by the 
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selection criteria. The stratification process produced 334 potential 
Institutional ^^v^^^clpants, and all 334 returned at least five useable 
questionnaires. Overall response rate for the total sample was 70.6% for 
administrators and 61.9% for faculty respondents. This response rate is 
somewhat better than the 40-50% response rates typical for surveys of this sort 
(Kerlinger 1972). 

For the purposes of this study, only responses for faculty and administrators 
were Included in the analysis. For estimating both instructional effectiveness 
and elements of institutional culture and functioning it was felt that trustee 
responses were too far from the actual situation to provide meaningful 
information. Indeed, past analyses using this database, and subsequent 
administrations of an essentially similar survey, the Institutional Performance 
Survey (IPS), have found that trustee responses can vary markedly from faculty 
and administrator perceptions (Krakower and Nlwa 1985). When trustee 
respondents were excluded from the analysis, nine institutions dropped below 
the minimum of five respondents per institution required for meaningful 
analysis, and were therefore excluded. 

A further five institutions were dropped from the analysis because meaningful 
data on selectivity could not be obtained. Initial analyses were performed on 
326 institutions without the selectivity variable, but the results indicated 
that the resulting regression models were badly misspecified— particularly for 
models directed toward explaining student cognitive development— if a measure 
of student selectivity was not included. 

The cross-section of institutions in the sample is broadly representative of 
categories of four-year baccalaureate institutions and above. Approximately a 
third are public, a quarter independent religiously affiliated, and the balance 
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private Independent Institutions. Over 80% are comprehensive or general 
baccalaureate, with about 10% major doctoral Institutions. Average FTE 
enrollment of Institutions In the sample Is 3800. The vast majority grant some 
professional degrees, and the average percentage of such degrees is over 60%. 
Similarly, most institutions in the sample enroll part-tirne students, with the 
average part-time enrollment being just over a quarter of headcount. Finally, 
student selectivity varies considerably around a mean combined SAT verbal and 
math score of 941 for the sample. 

Variables 

Instructional Effectiveness . As noted above, instructional effectiveness 
variables were operational ized in terms of items drawn from Section 8 of the 
APCU. They include twelve items used to build effectiveness scales on student 
educational satisfaction, student academic development, student career 
development, and student personal development. All twelve questions used a 
S-point Likert-type response format. The items used, grouped under their 
respective scale headings, are as follows: 

Student Educational Satisfaction 

- There seems to be a feeling that dissatisfaction is high among students 
at this institution (Item 805). 

- There have been relatively large numbers of students who either drop out 
or do not return because of dissatisfaction with their educational 
experience here (Item 806). 

- I am aware of a large number of student complaints regarding their 
educational experience here as registered in the campus newspaper. 
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meetings with faculty members or administrators, or other public forums 
(Item 807). 



Student Academic Development 

- Think of last year's graduating class at this Institution. Please rate 
the academic attainment or academic level achieved by that class as a 
whole (Item 812). 

- Estimate what percent of the graduates from this Institution go on to 
obtain degrees In graduate or professional schools (Item 813). 

- How many students would you say engage In extra academic work (e.g., 
reading, studying, writlny) over and above what Is specifically assigned 
In the classroom (Item 814)? 

Student Career Development 

- What proportion of the students who graduated from this Institution last 
year and entered the labor market obtained employment in their major 
field of study (Item 815)? 

- How many students would you say attend this college to fulfill definite 
career or occupational goals as opposed to attending for social, 
athletic, financial, or other reasons (Item 816)? 

- Of those students who obtained employment after graduating from this 
institution, for how many of them was career training received at this 
institution important in helping them obtain their jobs (Item 817)? 
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student Personal Development 

- One of the outstanding features of this tnstttutfon fs the opportunity 
It provides students for personal development In addition to academic 
development (Item 801). 

- There Is a very high emphasis on activities outside the classroom 
designed specifically to enhance students' personal, nonacademic 
dovel opmen t ( I tem 808 ) . 

- Students develop and mature in nonacademic areas (e.g., socially, 
emotionally, culturally) to a very large degree directly as a result of 
their experiences at this institution (Item 810). 

Original analyses using the APCU database explored scale values rather than 
individual items. Although respectable alpha values for scale reliability were 
obtained on the four student performance scales (for example, Krakower and Niwa 
report factors loadings from .68 to .85 for these items), some individual item 
values were sufficiently low as to cause suspicion that each item may tap a 
distinctive dimension of response when compared to its companions. Inspection 
of the texts of many items also raised questions about subsuming them under a 
common heading. As a result, in this study seperate regression models were 
estimated for each of the twelve instructional items. 

Institutional Characteristics . As noted above, data on institutional 
characteristics was drawn from outside the APCU survey— primarily from the 
Higher Education General Information Survey (HEGIS). A total of seven 
variables were created within this block, defined as follows: 
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FTE. This variable reports the total full-time equivalent enrollment 
for the Institution In 1983, as reported in HEGIS. 

% Professional Degrees , This variable reports the proportion of all 
degrees granted In 1982, as reported In KEGIS, that were In a designated 
professional field. 

% Part-Time Headcount , This variable reports the total proportion of 
1983 headcount enrollment at the Institution enrolling for fewer than 
fifteen hours at the undergraduate level and twelve hours at the 
graduate level, as reported In HEGIS. 

% Undergraduate Headcount . This variable reports the total proportion 
of 1983 headcount enrolled at the undergraduate level, as reported in 
HEGIS. 

Student Selectivity , This variable reports the average combined SAT 
verbal and math score (or its converted ACT equivalent) of Incoming 
freshmen at the institution in 1977, as reported In the annual 
Cooperative Institutional Research Program survey of Incoming freshmen, 
or In such publications as Barron's Profiles of American Colleges or the 
College Guide . 

Control , This variable was dumriy coded to reflect three categories—fl) 
public, (2) private independent, and (3) private with a religious 
affiliation. 

Institutional Type , This variable was durmy coded to reflect the 
following types of institutions: (1) major doctoral, (2) comprehensive, 
(3) general baccalaureate, and (4) specialty, 
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Institutional Mission and Mission Agreement , These variables were drawn from 
four Items In Section 4 of the APCU. All items were based on a 5-point 
Likert-type response format from "strongly disagree" to "strongly agree". The 
Individual Items are as follows: 

- This Institution has a special Identity, unlike any other In higher 
education (Item 403). 

- There is a general sense that this institution has a distinctive purpose 
to fulfill (Item 404). 

- The academic programs off erred here reflect the mission of the 
Institution (Item 405). 

- People associated with this institution share a common definition of its 
mission (Item 406). 

Exploratory analysis directed at the scalability of these items resulted in an 
overall coefficient alpha of .77. Once again, however, the dimensions of 
response tapped by individual items (particularly item 3) were felt to be 
sufficiently independent to warrant inclusion of each of the four items 
separately in the analysis. 

Institutional Culture . Section 5 of the APCU contains four items that require 
repondents to apportion 100 points among four statements about the institution 
on the basis of which statement most closely describes the respondent's 
institution. Prior use of the APCU database indicated that there was a close 
correspondence among the four items, and suggested that using the first item of 
the series as a predictive variable yielded results comparable to using a scale 
value based on all four items (Krakower and Niwa 1985). Because results for a 
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single Item are more easily Interpretable than for a multi-item scale, this 
procedure was used. The item chosen contains four broad statements about the 
Institutional environment. Each of these statements is associated with a 
particular conception of institutional culture. "CUn" cultures are highly 
personal and informal, emphasizing family-like ties among members and 
considerable loyalty and tradition. •'Emergent" cultures are dynamic and 
entrepreneurial, emphasizing development, progress, and innovation. 
"Hierarchy" cultures are formalized and tightly structured, emphasizing formal 
rules, efficiency and stability. Finally, "Market" cultures are 
production-oriented and task-oriented, emphasizing competetion and achievement. 
The text •>f each of the four statements defining these cultures in the APCU is 
presented below: 

- Clan . Institution A is a personal place. It is like an extended 
family. People seem to share a lot of themselv*^ . 

- Emergent ^ Institution B is a very dynamic and entrepreneurial place. 
People are willing to stick their necks our and take risks* 

- Hierarchy. Institution C is a very formalized and structured place. 
Bureaucratic procedures generally govern what people do. 

- Market. Institution D is very production oriented. A major concern is 
with getting the job done. People aren't very personally involved. 

Weightings assigned to each statement by each respondent were included as 
discrete variables in the analysis. 

Institutional Functioning . These factors were operational zed using four 
distinct items from Section 8 of the APCU. Although three of these Items were 
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originally designed to be part of a single organizational health scale, they 
appear to tap quite different elements of Institutional functioning. (Krakower 
and Niwa report an overall coefficient alpha of .83 for this scale, but 
obtained individual factor loadings as low as .55 for these variables.) As a 
result, each item was included separately as a predictor variable. All four 
items were scored as a five-point Likert-type scale anchored on opposing 
statements about the attribute. Texts for the four items used are given below: 

- General Level of Trust . High Suspicion, fear, distrust, insecurity vs. 
high trust, security, openness (Item 829). 

- Recognition and Rewards Receieved . Recognition received for good work, 
reward for success v£. no rewards for good work, no one recognizes 
success (Item 831). 

- Amount of information or Feedback . Feel informed, in-the-know, 
information is always available v£- feel isolated, out-of-it, 
information is never available (Item 832). 

- Student-Faculty Relationships . Unusual closeness, lots of informal 
interaction, mutual personal concern v£. no closeness, mostly 
Instrumental relations, little informal interaction (Item 826). 

Analytic Procedures 

Data were analyzed using a stepwise multiple regression procedure /ith forward 
inclusion of specified blocks of variables. Separate regressions were 
performed for each of the twelve student performance variables, and the results 
compared. Institutional Structural variables were introduced as the first 
block, followed by Mission variables, Instit^itional Culture variables, and 
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Institutional Functioning variables. Under forward Inclusion, variables are 
Included in the model at each step If they meet a specified significance level 
(In this case p « .OS), and once Included In the model, are carried through 
subsequent steps regardless of changes In their power as explanatory variables 
once other factors are Introduced. This procedure allows some of the 
structural relationships among explanatory variables to be explored as the 
regression procedure unfolds. 

This method was chosen for several reasons. As noted above, separate models 
were estimated for each of the twelve student performance Items, because each 
Item seemed to be tapping a somewhat different dimension of impact. Although 
the Items scaled reasonably well, some clearly asked for elements of 
Institutional Impact, while others asked for areas of emphasis or Intended 
Impact, or for the reasons why students were selected or attracted to the 
Institution. Because of these differences, each Item was considered 
representative of a somewhat different effect. 

Secondly, a stepwise procedure was employed to observe patterns of relationship 
among the four explanatory blocks of variables. As emphasized previously, a 
completely specified causal model was not attempted because of uncertainties 
over causal direction. While it has been often argued that such factors as 
size, control, and program array are prior to such factors as mission 
distinctiveness, mission agreement, and culture, it can be equally well 
maintained that the reverse is true: institutions may stay small, may offer 
certain programs, and ma^y maintain selectivity precisely because of a strongly 
held mission or institutional culture. Nevertheless, the degree to which such 
factors in^ '^oendently or jointly contribute to student performance is 
important, and the stepwise procedure allows it to be observed. 
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Results 



For the most part, results of the regression analysis confirmed hypotheses as 
expected. Some relationships, however, were not as strong as hypothesized, and 
other expected relationships were absent. Detailed results for each block of 
student performance variables are presented in Tables 1 through 4, For each 
block, results of applying the regression model to variances in student 
performance variables are also displayed. 

In each table, results are .^eported in terms of standardized regression 
coefficients (Beta-Coefficients) obtained when all significant variables are 
included in the model. Coefficients enclosed by parentheses in these tables 
are below the .05 inclusion criter.j for significance at the final stage of the 
step-wise regression procedure, but are included in the model because at an 
earlier step, they met the inclusion criterion. Finally, the total amount of 
variance explained (R2) at each step of the regression procedure is included in 
brachets. Results for each block of variables are disucessed in separate 
sections below. A final section discusses the results of regressing 
institutional characteristic variables on selected institutional function^ g 
variables that prior analyses had shown to be well correlated with student 
performance. 

Student Satisfaction 

The strongest associations with student educational satisfaction items were 
expected from (M mission distinctiveness and agreement, (2) a clan-like 
institutional culture, and (3) strong patterns of informal student/faculty 
contact. As shown in Table 1, these patterns indeed held true for the sample, 
but in somewhat different ways. 
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Table 1 



Results for Student Satisfaction Variables 

(805) (806) (807) 

High PlssaMsfactlon High Dropout High Complaint 

Institutiona l Characteristics ; 
Size -.154 -.194 

Public Control -.209 -.165 -.7,12 

Private Independent .101 
C>Tiprehens1ve -.186 
* Part-Time 

% Professional -.167 
% Undergraduate 

High Selectivity (SAT) -.105 -.3J6 

[R2 Step 1] [.049] [.100] [.020] 

Mission: 

sped a. Identity (403) .171 
Distinctive Purpose (404) -.171 
Programs Reflect Mission (405) -.080 

Shared DefinUion of Mission (406) -.099 -.225 
[R2 Step 2] [.201] [.218] [.166] 

Institutional Culture : 
Clan (-.056) (-.051) -.137 

Emergent (-.067) 
Hierarchy .204 .096 

Market 

[R2 Step 3] [.269] [.231] [.196] 

Institutional Functioning: 

High Trust (829) -.212 -.190 

High Reward (831) 

High Feedback (832) -.128 -.117 -.127 

High «'*udent/Faculty Contact (826) -.235 -.231 -.195 

[Total R2] [.643] [.302] [.311] 

N « 320 



All coefficients represent unstandardized regression coefficients in the final model. 
(Beta coefficients In parentheses were not significant in the final model , but were 
significant at an earlier stage of the step-, se regression procedure.) 
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High levels of student dissatisfaction (Item 805) were strongly associated with 
non-public control, with a hierarchical Institutional culture, with low levels 
of trust In Institutional functioning, and with Infrequent st^Jent/ faculty 
contact. Somewhat surprisingly, dissatisfaction was moderately associated with 
small size ^nd with private Independent control. It Is likely that these 
results are due to the Inability of many small Independent Institutions to 
deliver effectively In the areas of careei preparation and academic quality for 
students who are Instrumental ly motivated. Mar\y such students may attend small 
Institutions for the wrong reasons, and are disappointed as a result. 

As noted In much of the literature on student retention (for example Lenning, 
Beal , and Sauer 1980; Seal and Noel 1979), the factors associated with dropout 
are not necessarily those associated with satisfaction or with academic 
success. These results Indicate high dropout (Item 806) to be strongly 
associated with low selectivity, with Infrequent student/ Faculty contact, and 
with Institutions which lacked agreement on mission definition. Each of these 
relationships Is paralleled by findings In behavioral research on student 
persistence (Terenzlnl and Pascarella 1977). As above, however. It Is 
Interesting to observe that public control and size, as well as percent 
professional degrees, are negatively related to dropout with other factors held 
constant. This suggests as well that student persistence may well be a 
function of both the "Integration" of the student with the campus— as suggested 
by most retention models (Tinto 1975) —but may also be related to the ability 
of the Institution to "deliver the goods" In terms of competitive programs that 
provide good job opportunities. 

Complaint, like dropout, is a form of behavior that embodies dissatisfaction. 
Unlike dropout, however, it depends upon there being a public opportunity to 
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express dissatisfaction, and upon a motivation to communicate rather than to 
withdraw. Indeed, it can be argued that high levels of dialogue—even If they 
are oriented toward criticism— may themselves be Integrative. Results on the 
High Complaint Item (Item 807) In man) ways parallel those on the other two 
student satisfaction Items, but seem more to depend on mission and culture 
factors than do the others . 

On all three Items, the pattern of variance explained by successive steps of 
the regression process Is revealing. In each case. Institutional 
characteristics variables, though Important, alone explained very little of the 
variance In svident satisfaction. For dissatisfaction (Item 805), considerable 
gains in explanatory power come largely with mission and institutional 
functioning factors. For dropout (Item 806) and for complaint (Item 807) this 
pattern is also true, although the particular independent items that emerge as 
significant predictors are different, and the total amounts of variance 
explained by the regression model differ considerably. At minimum, however, 
this pattern of successive results demonstrates the additional power of 
including cultural and organizational functioning variables in analyses of this 
dimension of performance. 

Student Academic Development 

Hypothesized relationships on student academic development factors were few and 
concentrated. High academic gains were expected to be strongly associated with 
institutional selectivity, and were expected to be moderately associated with 
frequent student/faculty contact and with high information and feedback. 
Previous work also suggested a moderate negative relation with part-time 
attendence. 
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As Indicated in Table 2, selectivity Indeed proved dominant for all three Items 
of student academic development. As expected, part-time attendance was related 
to achievement In a moderate and negative fashion. A similar finding Involved 
moderate and negative relationships between professional orientation and 
acceptances In graduate schools, and student willingness to engage In extra 
academic work beyond classroom assignments. Interestingly, however, the 
presence of a graduate school exerts. If anything, a positive effect on total 
achievement levels—a finding consistent across all three itwns on this 
dimension. 

Parallel results on all three items are also apparent in the area of mission. 
Here it seems clear that distinctiveness of purpose, per se, has little to do 
with achievement levels, but that the match between actual program delivery and 
intended purpose, and the fact that people agree on mission are Important. 
Inspection of stepwise regression results, however, reveals that in contrast to 
satisfaction variables, mission variables do not account for a great deal of 
variance in student achievement Independent of institutional characteristics. 

Although some relationships between institutional functioning variables and 
student achievement were identified, these were surprisingly weak. The nioi^t 
prominent was that between high student/faculty contact and students engaging 
in extra academic work beyond the classroom (Item 814). Engaging in additional 
uriassigned academic work appears to be a somewhat distinctive dimension of 
academic performance—a conclusion reinforced by the fact that this item is 
less strongly associated with initial selectivity than the other two. This 
item is also characterized by a unique negative association hierarchical 
institutional culture. Unlike Items 812 and 813, work outside the classroom 
reflects the "value added" developmental notion of undergraduate teaching 
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Table 2 



Results for Student Academic Development Variables 



(812) (813) (814) 

Student % Professional/ Extra 

Achievement Graduate Academic Work 

Institutional Characteristics ; 
Size 

Public Control 
Private Independent 
Comprehensive 

% Part-Time -.150 

% Professional -.164 -.159 

% Undergraduate -.169 -.135 -.195 

High Selectivity (SAT) .621 .521 .379 

[R2 Step 1] [.524] [.448] [.313] 

Mission: 

Special Identity (403) .140 .127 

Distinctive Purpose (404) 

Programs Reflect Mission (405) .136 .157 

Shared Definition of Mission (406) (.069) .152 

[R2 Step 2] [.591] [.505] [.396] 

Institutional Culture ; 
CTan 

Emergent 

Hierarchy (-.057) -.133 

Market 

[R2 Step 3] [.596] [.505] [.409] 

Institutional Functioning ; 
High Trust (829) .106 
High Reward (831) 
High Feedback (b32) 

High Student/Faculty Contact (826) .128 
[Total R2] [.603] [.505] [.440] 

N = 320 



All coefficients represent unstandardized regression coefficients in the final model . 
(Beta coefficients in parentheses were not significant in the final model , but were 
significant at an earlier stage of the step-wise regression procedure.) 
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(Astin 1977). N: t all Institutions can be selective. These findings provide 
some grounds for believing that additional Increments In student academic 
performance can be attained by Influencing patterns of culture and 
Institutional functioning. The strength of the findings, however, suggest that 
that such gains may be relatively small when compared to differences In 
achievement resulting from different evels of aptitude In the Incoming student 
body. 

Student Career Development 

Like academic achievement, student career development was expected to exhibit 
stronger patterns of association with Institutional characteristics variables 
than with Institutional culture and functioning variables. Strong 
relationships were expected between student career development and such 
characteristics as professional orientation and percent part-time. Moderate 
relationships were expected with mission and institutional functioning factors 
in so far as institutional purpose was oriented toward occupational 
development, and in so far as programs actually reflected this purpose. 

Inspection of Table 3 indicates that for the most part these expectations v/ere 
met in the analysis. For all three items on this dimension, very few factors 
emerged as important beyond those mentioned. Percent professional degrees is 
of considerable importance for all three career development items, and percent 
part-time attjndence is important in two of the three. It is Interesting to 
note that the profile of Item 816 is somewhat different from other career 
development items because it is not a true performance factor. Most part-time 
students attend with an occupational goal in mind. But eeking a primarily 
occupational goal ^n the first place is quite different from actually attaining 
Job placement and success as a result of college. 
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Table 3 



Results for Student Career Development Variables 



(815) (816) (817) 

Preparation 

Job In Field Job is Goal for Job 



Institutional Characteristics : 
Size 

Public Control 
Private Independent 
Comprehensive 
% Part-Time 
% Professional 
% Undergraduate 
High Selectivity (SAT) 
LR2 Step 1] 

Mission: 
Special Identity (403) 
Distinctive Purpose (404) 
Programs Reflect Mission (405) 
Shared Definition of Mission (406) 
[R2 Step 2] 

Institutional Culture : 
Clan 

Emergent 

Hierarchy 

Market 

[R2 Step 3] 

Institutional Functioning ; 
High Trust (829) 
High Reward (831) 
High Feedback (832) 
High Student/Faculty Contact (826) 

[Total R2] 

N = 320 



.577 

.161 
[.265] 



.224 
[.333] 

.185 
[.357] 



.337 
.339 

.166 
[-260] 



.306 
[.349] 



[-349] 



[.357] 



[.349] 



-.085 
.107 
.632 



[.411] 

.261 
[.485] 



[.485] 



[.485] 



All coefficients represent unstandardized regression coefficients in the final model. 
(Beta coefficients in parentheses were not significant in the final model , but were 
significant at an earlier stage of the step-wise regression procedure.) 
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In the area of mlbMon, the fact that programs delivered actually reflect 
mission emerges as strongly related to all three student career development 
Items. It can, of course, be reasonably assumed that both the programs and 
mission referred to are occupational. What Is Interesting here Is the fact 
that effectiveness Is related not so much to mission distinctiveness, but 
rather to consistency In carrying out a mission even though the mission Itself 
may be generally perceived to be a common one. 

Student Personal Development 

As suggested by past studies, patterns of student non-academic development were 
expected to be strongly related to Institutional mission, culture and 
functioning. Strongest among these expected relations were distinctive mission 
and mission agreement, a "clan-like" institutional culture, and strong patterns 
of student/faculty contact. Institutional characteristics such as public 
control, size and percent part-time were expected to be negatively related to 
student personal development, though at a moderate level. 

As Table 4 indicates, this pattern of relationships was indeed the case, and 
there was considerable consistency in the results obtained for each of the 
three items that constitute this dimension. The only major difference from 
hypothesized relationships was the fact that institutional characteristics 
proved more powerful than initially expected. Both public control and percent 
part-time emerged as consistently important factors on all three student 
personal development items. Similarly, high levels of student/ faculty 
relations were consistently important across all three items. 

Mission and institutional culture factors, however, showed mixed results. Clan 
culture was indeed associated with personal development for all three items, 

32 

34 



Table 4 



Results for Student Personal Development Variables 



Institutional Characteristics: 
"TTze 

Public Control 

Private Independent 

Comprehensive 

% Part-Time 

% Professional 

% Undergraduate 

High Selectivity (SAT) 
[R2 Step 1] 

Mission: 
Special Identity (403) 
Distinctive Purpose (404) 
Programs Reflect Mission (405) 
Shared Definition of Mission (406) 
[R2 Step 2] 

Institutional Culture : 
CTan 

Emergent 
Hierarchy 
Market 
[R2 Step 3] 

Institutional Functioning : 
High Trust (S29) 
High Reward (831) 
High Feedback (832) 
High Student/Faculty Contact (826) 

[Total R2] 



(801) 
Personal 
Development 



■ .184 

■ .177 



[.328] 



.132 
.194 



[.367] 
.216 

[.459] 



.096 
.307 



(808) (810) 
Emphasize Non-Academic 
Non-Academic Development 



-.234 
(.089) 

-.386 
.201 



[.540] 



[.351] 



.175 
(.146) 

(.027) 
[.380] 



(.087) 

[.397] 

.112 
.255 
[.453] 



-.181 
-.338 

[.321] 

.142 
[.373] 

(.067) 
[.400] 



.103 
.211 



[.426] 



N = 320 



All coefficients represent unstandardized regression coefficients in the final model . 
(Beta coefficients in parentheses were not significant in the final model , but were 
significant at an earlier stage of the step-wise regression procedure.) 
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but only In the case of Item 801 did the relationship persist when 
Institutional functioning factors were Introduced Into the model. Mission 
factors showed a variety of patterns, none of them strong. And as seen In the 
results of the step-wise regression procedure, mission factors explained 
relatively little unique variance In student personal development Items. 

Institutional Functioning as a Mediating Variable 

As mentioned In the discussion of methodology above, attempting to specify a 
causal model for Institutional characteristics, cultures, and performance 
factors Is a tricky exercise because of many uncertainties about the true 
nature of causal direction. A rigorous causal estimation procedure such as 
LISREL was therefore not used In this study. Nevertheless, patterns In the 
regression results that Indicated the power of such Institutional functioning 
items as student/faculty contact (Item 826) and high levels of organizational 
information and feedback (Item 832) in explaining some elements of student 
performance suggested investigation of these items as mediating factors in 
explaining student performance, furthermore, a basic thrust of major recent 
national reports, most notably that of the NIE Study Group on the Conditions of 
Excellence in American Higher Education (NIE 1984), is that Increased rtudent 
involvement and feedback are important Ingredients in actually improving 
student performance. For this reason, exploring the role of student/faculty 
contact and of organizational information and feedback as policy levers for 
improving performance was additionally compelling. 

Because of the stepwise regression process employed above, it was possible to 
examine results on all twelve student performance items without including 
student/faculty contact and information and feedback. Results indicated that 
inclusion or exclusion of these iteins considerably changed the pattern of 
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coefficients on other Items—particularly for those factors having to do with 
mission and culture. These differences were strongest for stuoent satisfaction 
and personal development items, and were least strong for student career 
development, items. 

To supplement these results, separate regressions were run on student/faculty 
contact (Item 826) and on levels of organizational information and feedback 
(Item 832) using institutional characteristic, mission, and institutional 
culture variables as predictors. The intent of this analysis was 
exploratory— to see If institutional characteristic, mission and institutional 
culture factors might be predictlvely linked to these items, which might in 
turn operate as mediators of student performance. 

Results of these further regressions are presented in Table 5. First, a 
considerable amount of the variance in student/faculty contact car be explained 
in terms of prior characteristics* The strongest factors associated with 
student/ faculty contact are institutional size and percent part-time—both 
negative associations. It is interesting to note that public control and 
private independent status both enter the analysis strongly associated with 
student/ faculty contact, but the association evaporates when mission and 
cultural variables are introduced into the model. It is also interesting to 
observe that it is not inission distinctiveness that is related to 
student/facul ty contact but instead agreement on mission. Finally, 
student/ faculty contact is strongly related to patterns of culture— positively 
to a "clan-like" environment, and negatively to a "hierarchical" environment. 

The pattern of results for information and feedback shows a somewhat different 
picture. In this case, institutional characteristics account for almost none 
of the variance in this area of functioning, and the only factor significantly 
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Table 5 



Results for Selected Institutional Functioning Variables 



(832) (826) 

High Faculty/ 
High Feedback Student Contact 

Institutional Characteristics ; 
Size -.220 
Public Control (.008) 
Private Independent (-.074) 
Comprehensive 

* Part-Time -.110 
% Professional 
% Undergraduate 

High Selectivity (SAT) .102 
[R2 Step 1] [.024] [.393] 

Mission: 

Special Identity (403) -.243 
Distinctive Purpose (404) 

Programs Reflect Mission (405) ,279 

Shared Definition of Mission (406) .252 .106 
[R2 Step 2] [.234] [.459] 

Institutional Culture ; 
Clan .426 
Emergent .197 
Hierarchy -.166 
Market 

[R2 Step 3] 

[Total R2] [.271] [.608] 

M = 320 



All coefficients represent unstandardlzed regression coefficients in the final model 
(Beta coefficients in parentheses were not significant in the final model , but wer-e 
significant at an earlier stage of the step-wise regression procedure.) 
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related is Institutional selectivity. Mission variables, however, are strongly 
related to Information and feedback—particularly those that have to do with 
actual delivery on mission rather than mission distinctiveness. 



Taken together, the5>e results are suggestive that increased student/ faculty 
contact can be fostered In a variety of Institutional circumstances, primarily 
by operating on mission agreeme.it and Institutional culture variables. 

Implications 

Findings of this research have several successive layers of Implications. At 
the most general level, these results caution researchers against the dangers 
of attempting to directly link observable attributes of colleges and 
universities—for example size, control, and selectivity— with particular 
patterns of educational outcomes. Indeed, these results suggest that the 
presence or absence of particular cultural or Institutional functioning factors 
maiy have a great deal to do with both the kinds and levels of outcomes 
produced. At a somewhat different level, these findings also suggest that 
mission differentiation and agreement are Important elements In achieving 
effectiveness: "generic" outcomes are rare In higher education, and dl/rerent 
types of Institutions are better equipped than others to deliver on particular 
performance dimensions. Finally, these results show the potential efficacy of 
some particular policy levers available to most Institutions. Indeed, results 
suggest that some structural factors that are often held to bs Insurmountable 
obstacles to Improving undergraduate Instructional quality may not be so 
Intractable as Is often maintained. All such Implications, however, are 
suggestive, and reinforce a call for further inquiry. 
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"Non-Matftrlal " Determinants of Effectiveness 
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One purpose of this study was to explore the relative power of cultural, 
institutional functioning, and mission variables In explaining different 
patterns of student performance outcomes. While past literature on 
organizational effectiveness makes extensive use of such concepts as potential 
determinants of organizational performance, the concept of effectiveness 
employed Is a very broad one. Empirical studies of student outcomes, in 
contrast, have concentrated on explaining a highly circumscribed dimension of 
institutional performance, but have tended to use as explanatory variables only 
such factors as institutional size, type, control, program array and 
sel activity. 

Results of this study provide considerable grounds for arguing that 
"non-material" factors such as mission direction and specification, a 
"clan-like" or hierarchical institutional culture, and such elements of the 
organizational environment as reward and recognition for achievement, high 
information and feedback, and close contact between faculty and student^, may be 
Important Independent determinants of student performance. On eacn of the four 
basic dimensions of student performance investigated, such factors made 
significant unique contributions to explained variance. Furthermore, in most 
cases, each of the three additional blocks of "non-material" variables 
(mission, institutional culture, and institutional functioning) made a unique 
contribution to variance explained. 

For the most part, the relative power of "non-material" variables on individual 
dimensions of student performance were consistent with current discussions in 
the literature on student learning and development. Unique contributions 
attributable to "non-material" factors were least for student career 
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development and academic achievement, and greatest for student satisfaction and 
non-academic development. More Importantly, for those outcomes areas that 
actually reflect student change or "vali;€-added"~for example, engaging In 
additional academic work teyond classroom assignments-- "non-material" factors 
were relatively more Important as predictive variables, 

A major argument often a<:vanced against attempting reforms In undergraduate 
Instruction rests on the premise that Immutable structural factors prevent the 
kinds of strategies known to be effective from being generalized from a very 
specific range of settings. Because Innovative instructional approaches*, are 
often drawn from small colleges, administrators at larger institutions tend to 
automatically dismiss them as Irrelevant or, from an imple^nentatlon standpoint, 
1m':>oss1bie. The r ct that "non-material" factors such as student/ faculty 
contact accounted for notable differences In outcomes, even after controlling 
for differences in setting, tends to Indicate that such content1r>ns are 
unbounded. If "non-material" factors are appropriately attended to. Important 
additional gains In effectiveness seem quite possible. 

Effectiveness and Ml? iion Sped fid ty 

One major implication of recent work on institutional effectiveness in higher 
education is that agreement on mission, and consistency in carrying out the 
concrete implications of Institutional mission are Important elements in 
developing effective strategy. For example, Chaffee (1984) documents the cases 
of several small colleges that developed effective "turnaround" st»^ategies by 
ensuring that adaptational response to shifts in the environment were 
consistent with well -articulated and strongly held notions of mission. 
Institutions that Ignored the need for such consistency were l^^^^s effective in 
their adaptational efforts. 
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The results of the present study suggest that there fs indeed a connection 
between strongly held and articulated missions, and institutional performance. 
They suggest further that different types of institutions seem tu achieve and 
to value quite different kinds of outcomes* First, mission variables emerged 
as significant predictors for all twelve student performance items— a fact not 
true of any other block of variables with the exception of institutional 
cha-^acteristics. Secondly, mission variables were of two types, and each type 
tended to have a somewhat different kind of impact on student performance, 
items 403 and 404 tap the distinctiveness of an institution's mission—the 
degree to which respondents perceived the institution's purpose to be special, 
unique, or at least differentiable from that of other institutions. These 
items appeared to be most related to student satisfaction and non-academic 
development— a finding that reinforces general perceptions that institutions 
that emphasize their distinctiveness tend to do so in non-academic areas (for 
example, Martin 1982, Astin and Lee 1972). Items 405 and 406, on the other 
hand, stress the level of agreement on mission, and the consistency with which 
the institution is actually delivering programs in line with its stated 
mission. These items seem most related to career development and to academic 
achievement. It is particularly interesting to note that both types of mission 
items are important in determining such "value-added" performance criteria as 
undertaking additional unassigned academic work and placements In graduate or 
professional schools. 

Although far from conclusive, this pattern of results implies that (1) 
diversity of mission seems related to important differences in non-academic 
student development, and (2) consistency in articulating and carrying out 
1r £.Mtutional mission--whatever the institution's basic thrust— is important 
for achieving both academic and non-academic results. Institutions that lack 
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focus In their missions, regardless of mission content, may thus be at a 
disadvantage In delivering effective s. dent performance. 

Some Policy Levers for Change? 

Recent national reports that call for Improv^fment of undergraduate Instruction 
have pointed to a number of factors that are expected to positively Impact 
student learning and development. Two of the most Important of these f ctors 
are ^ ,creased Involvement In the curriculum, and consistent feedback on 
performance (NIE 1984, AAC 1985). Furthermore, the^e reports have emphasized 
that Involvement and feedback should be Instltutlcn-wlde phenomena: they should 
be as true of administrative behavior as of behavior In the classroom. 

The results of this studly provide some support for these policy directions. 
Both student/ faculty relations (Item 826) and an administrative environment 
that provides substantial Information and feedback (Item 832) were consistently 
and positively related to non-academic development and student satisfaction. 
Such factors, however, were not significant In accounting for student academic 
achievement or career development. 

If Institutional functioning factors such as these are Indeed Instrumental In 
producing certain desirable outcomes, the question arises as to how they 
themselves can be Induced. Study results indicate that both factors are 
remarkably Independent of predetermined Institutional characteristics. For 
student/ faculty contact, the results Indicate strong zero-order linkages with 
public control, with total enrollment, and with the percentage of students 
enrolled part-t1me--all of which are consistent with conrronly held perceptions. 
But when institutional culture and mission factors are introduced, these 
relations are considerably modified, and "non-mater iaV factors account for 
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considerable additional variance. In the case of administrative functioning 
that stresses Information and feedback. Institutional characteristics alone 
account for almost no variance. The bulk of the explainable variation In this 
factor Is attributable to mission and culture variables, 

T^i Implication of all these findings taken together tends to break the 
presumed direct linkage between an institution's physical environment and the 
kinds of outcomes that it is capable of producing. Rather than dismissing 
strategies developed in other settings, institutional administrators should be 
made aware of the many significant gains in student outcomes that can be made 
by shaping and sharpening institutional mission and by refining the 
institutional culture within which instruction takes place. 
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too. 0 




TOTAL 


2d6 


too.o 


too.o 
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PETER EUELLj INSTITUTIONAL PERFORHANCE SURVEY 1983 

s:rtPLE OESCRIPTIVES FOR ALL VARIABLES 
FILE S*)VEU7 <CREATION DATE • 9/24/B5> 



UEO, NOV 13, 1983, I2f05 PH 



PrCE 



VARIABLC FTE83 



TOTAL FTE 83 



MEAN 

KURTOSIS 
HAXIMUn 



3805.098 

3.131 

20286. ooa 



STO ERROR 
SKEUNESS 



223.330 
1 .833 



STO DEV 
MINIMUM 



4068. 443 
1^^ . 000 



VALID OBSERVATIONS 



326 



MISSING OBSERVATIONS 



VARIABLE PPR0F82 



^PROFESSIONAL DECS 82 



MEAN 

KURTOSIS 
MAXIMUM 



62.626 
1 . 096 
100.000 



STD ERROR 
SK£yNES8 



I .244 
-1.216 



STO OEV 
MINIMUM 



22.432 

. 000 



VALID OBSERVATIONS 



326 



MISSING OBSERVATIONS 



VARIABLE PPTNCB3 



^PART TIHE HEADCOUNT 63 



MEAN 

KURTOSIS 
MAXIMUM 



27.108 

-.179 
94.009 



STD ERROR 

SKEUNESS 



1 .030 
.641 



STD OEV 
MINIMUM 



18.596 

, 000 



VALID OBSERVATIONS - 



326 



MASSING OBSERVATIONS - 



VARIABLE PUGNC83 XUNDERGRAD HEADCOUNT 83 



MEAN 

KURTOSIS 
MAXIMUM 



80.337 
3.133 
I 00. 000 



STO ERROR 
SKEUNESS 



.942 
-1 .434 



STO DEV 
MINIMUM 



17. 004 

. 000 



VALIO OBSERVATIONS 



326 



MISSING OBSERVATIONS 



VARIABLE SATVM77 



SAT VCRBAL^MATH 77 



MEAN 

KURTOSIS 
MAXIMUM 



940.373 
1.079 
1340.000 



STO ERROR 
SKEUNESS 



6.783 
.380 



STO OEV 
MINIMUM 



121 .328 

39;>. 000 



VALrO OBSERVATIONS 



321 



MISSING OBSERVATIONS - 
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PETER EWELLj institutional PERFORhANCE SURVEY 1983 

SIHPLE OESCRIPTIVES FOR ALL VARIABLES 
riLE SMVEW7 < CREATION DATE ■ 9/24/85) 



UEO, NOV 13, f985, !2i05 PM 



PAGE 



VARIABLE M5IA 



StCt 5 QutSt 1 CLANk Adiiln4>F«c MEAN 



MEAN 47.674 
KURTOSIS -.74t 
MAXIMUM 86.250 


STD ERROR 
SKEWNESS 


.997 
-.259 




STD DEV 
hIKIMUM 


ta,oo4 

5.000 


VALID OBSERVATIONS - 326 


MISSING 


OBSERVATIONS - 


0 






VARIABLE M5IB SftCt 5 QUftSt 

MEAN 17.751 
KURTOSIS 1.256 
MAXIMUM 53.333 


1 EMERGENT J Adaln>F«c 

STD ERROR 
SKEWNESS 


MEAK 

.492 
I . 077 




QTA r>CKI 
9tV PC V 

HINIMUM 


8 . B76 
2.000 


VALID OBSERVATIONS - 326 


MISSING 


OBSERVATIONS - 


0 






VARIABLE M5IC SftCt 5 OuftSt 

«EAN ?S.972 
KURTOSIS .157 
MAXfMUM 57.143 


HIERARCHV} AdMln^Fac 

STD ERROR 

SKEUNESS 


MEAN 

.65B 
.818 




STD DEV 
MINIHUM 


1 I .877 

.833 


VAL*D OBSERVATIONS - 326 


MISSING 


OBSERVATIONS - 


0 







VA'^IABLE M5ID 

MEAH 

KURT0SI<S 

MAXIMUM 



S«ct 3 OuftSt ! MARKET I AdMln^Fac MEAN 



t3.424 
! .014 
33.57J 



STD ERROR 

SKE'^NESS 



.522 
.923 



STD DEV 
MINIMUM 



9.42B 
. 000 



VALID OBSERVATIONS 



326 



MISSING OBSERVATIONS 



VARIABLE JCC!ADJ INTRACLAS8 CORR.SECT 5 Qt ADJUSTED 



MEAN 

KURTOSIS 
MAXIMUM 



.462 

'! .292 
.953 



STD ERROR 
SKEUNESS 



.016 
-.067 



STD DEV 
MINIMUM 



.296 
. 000 



VALID OBSERVATIONS - 



326 



MISSING OBSERVATIONS 
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rETER EyELLi INST ITUT lON^^L PERFOH««NC£ HUP^Er 1983 yco „ov 13 1985 i ;? . 05 pm p^rr 

SIHPLE DESCRIFTIVES FOR ALL VARIABLES ' ' ^^^^ 

FILE SAVEy? <CREATION OATE - 9/24/65 > 



VARIABLE n403 



S«ct 4 Qutst 3i AdMln^Fac NEAN 



HEAN 

KURTOSIS 
MAX I NUN 



3.171 
-.713 
4.889 



STD ERROR 
SKEMNESS 



.041 
.134 



STD DEV 

h:nimun 



.738 
1 .371 



VALID OBSERVATIONS 



326 



NISSINC OBSERVATIONS 



VARIABL;^ N404 



t«ct 4 Qutst 4i AdMlrfFac NEAN 



HEAN 

•:0RT0SI8 
NAXINUN 



3.B43 

.133 
3.000 



STD ERROR 
SKEJNESS 



.032 
-.422 



STD DEV 
NININUN 



.37 
t .800 



VALID OBSERVATIONS 



326 



NISSING Cr'^ERVATIONS * 



VARIABLE ^^03 8«ct 4 Qutst 3i ^n1»ln*F»c NEAN 

miosis IJEyHE^r '.II l]^ 

NAXINUN 4.833 8KEyHE8S -.594 HiNlNUN 2.300 

VriiD OBSERVATIONS - 326 NISSINC OBSERVATIONS - 0 



VARIABLE N406 



Stct 4 Qutst 61 Ad»in>Fac NEAN 



HEAN 

KO.RTOSIS 
HAXIHUH 



3.373 
-.345 
4.700 



STD ERROR 
SKEyNESS 



.033 
-.270 



STD DEV 
HININUH 



.392 
I .800 



VALID OBSERVATIONS 



326 



NISSING OBSERVATIONS - 



VARIABLE N80> 8«ct • r^mmt tt Ad»ln>F«c HEf^N 

SSr7oSIS ^'lll STD ERROR .032 STO OEV .380 

VALID OBSERVATIONS - 326 „,snNC OBSERVATIONS - 0 
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V«RI«BLE MBO, s.ct 8 Ou..t „ „e«N 

HEAN 2 

KURT0SI3 s>T CRnOH .as? 

HAXIHUN j. MJ S«yNES8 . 9T0 0EV 

ni M IHUM I , 1 67 

V. ,ID OBSERVATIONS - 324 

"ISSINC OBSERV^^TIONS - q 

VARIABLE N80S s.r* ---- ^ 

Stct B outft 61 Rd»ln4F*c HERN 
HEAN i , 1 50 

KURTOSIS 7t,i 8T0 ERROR .jj, 

^^^IHUH 4:200 SKEyNESS .^^^ 8T0 OEV .5,^ 

niN IHUH I . I 25 

VALID OBSERVATIONS - 326 

"JSSINC OBSERVATIONS - q 

VARIABLE f1807 s^^* * 

"E'**^ 2.0SB 

KURTOSIS • ..7 »T0 ERROR , ©24 

HAXnUN 4; 000 SKEyNESS .904 H^^.^J"!^ .Of 

VALID OBSERVAUONS - 32^ 

"JSSINC OBSERVATIONS - q 

VARIABLE HBOd s.rf fta 

Stct B Quttft St AdMln^Fac HEAN 

HEAN 3 23 0 

KUPT0SI8 .'405 «T0 ERROR 039 

HhVIHUH 4.429 SKEyNESS -.383 629 

HINIHUH 1.500 

VALIO OBSERVATIONS - 32$ 

"^SSINC OBSERVATIONS - q 

V^^RIABLE H8I0 o.^ti 

Stct ^ Pu.,t lOi Ad»ln*F«c HEAN 

3.456 

KURTOSIS 353 STO ERROR .3. 

HAXIHUH 4*^^; SKEyNESS . 748 8^0 OEV 33© 

* " HINIHUH ,.600 

VALID OBSERVATIONS - 32$ 

HISSING OBSERVATIONS - 0 
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i^lrtPLE DESCRIPTIVE^ FOR ALL VARIhBLES 
FILE SAVEy? <CREAT10N DATE • 9/^4/85) 



WED, NOV 13, 198S, |2:05 PM PA.-,E It 



VARIA8LE H8t2 
NEAN 

KURTOSIS 
NAXINUN 



Sect 8 Qutst t2i AdMln4F*c hEAN 



3. 186 
.107 
5. 167 



STD ERROR 
SKEMNESS 



.04 0 
.250 



STD DEV 
HINIHUH 



.727 
t . 143 



VALID 08SERVATI0NS - 



32 



HISSING OBSERVATIONS 



VARIABLE net 3 

NEAN 

KURTOSIS 
NAXINUH 



S«ct • Outst 13i Ad»tn4>F«c HEAN 



5. 195 
t . I 15 

6 . ",25 



STD ERROR 
SKEMNESS 



. 046 

-1 .020 



STD DEV 
HINIHUH 



.837 
1 .667 



VALID OBSERVATIONS 



326 



HISSING OBSERVATIONS 



VARIABLE H8t4 
HEAN 

KURTOSIS 

HAXinun 



S«wt 8 Qu«st 141 Ad»in4>F*c HEAN 



7.356 
2.21S 
^.333 



STD ERROR 

SKEWNCSS 



. 038 
1 . 108 



STD DEV 
NINIHUH 



.690 

2.000 



VALID OBSERVATIONS - 



326 



HISSING OBSERVATIONS 



VARIABLE H815 
HEAN 

KURTOSIS 
NAXIHUH 



8«ct 8 Quest 15i Ad»in«>F«c 



HEAN 



4.936 

-.224 
6.857 



STD ERROR 
SKEUNE38 



.033 
•.398 



STD DEV 
KINIHUH 



.686 
3. 000 



VALID OBSERVATIONS 



326 



HISSING OBSERVATIONS 



VARIABLE H816 
HEAN 

KURTOSIS 
HAXIHUH 



S«ct 8 QUicSt 161 Ad»ln4>F*c HEAN 



S.364 
. 398 
6.667 



STD ERROR 
SKEyHESS 



. 034 
•.470 



VALID OBSERVATIONS - 



326 



HISSING OBSERVOTIONS - 



STD DEV 
HINIHUH 



.610 
3. 000 
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PtTtR tWPLLj INSTITUTIONAL PERFORHANCe SURVEY i<»nt 

SIMPLE OESCRZFTIVES FOR ALL VARIABLES ,2.03 Ph PACE ,1 

FILE SmVEM? <CREAT10N DATE - $/24/85 ) 

VARIAeLE N8f7 s.ct 8 Ou«t ,7. Ad^«n>Fac HEAN 

?fiS?nftfc ''^^^ STD ERROR 040 

HAXINUH 6.857 ' MINIHUH 2 



VALID OBSERVATIONS - 

HISSING OBSERVATIONS - 



VARIABLE H826 



S«ct 8 Ou«st 26 1 Admln + Fcc KEAN 



HAXIHUH 3., 67 SKEyNESS .^4 HINIHUH ,111 



VALID OBSERVATIONS - 32* 

HISSING OBSERVATIONS 



VALID OBSEPVATIOKS - 32* 

HISSING OBSERVATIONS 



VARIABLE HB29 s.ct 8 Ou«t 2f > AdMn^F.c MEAN 

HEAN 4 at A 

HAXInun 6.500 SKEyNESS .064 „,„,„i,„ jJJJ 

VrtLID OBSERVATIONS - 320 

MISSING OBSERVATIONS - 0 

VARIABLE H83I s.ct 8 Ou..t 3,. Ad.ln.F.c HEAN 

HEAN 3 

KUPTOSIS 8TD ERROR .033 STbnru 

HAXlHtrH ^1 S«yNESS 400 633 

HAXIHUH 6.000 ^ HINIHUH 1.90O 

VALID OBSERVATIONS - 32A 

HISSING OBSERVATIONS - a 



VARIABLE HB32 s.Ct 9 Qu«t 32. Ad.in.F.c HFAN 

MEAN ■■ ABi 

icURToqKl STD ERROR 03- 
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